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In an effort to support Carroll’s premise that there might be a relationship 
between foreign language aptitucie and the degree to which the learner Is capable of 
coping with the pace of language instruction, this study describes fhe comparative 
effectiveness of predicting student language learning potential through the Pimsieur 
Aptitude Battery, teacher evaluations, and student self evaluations. A discussion of 
the project design includes information on details of (1) administering the aptitude 
battery to 1,58/ first-year foreign language students in five Tucson public high 
schools, (2) the development of the language aptitude data for each individual, and 
(3) the results of the correlational studies, rive tables of statistical data supporting 
an outline of tentative conclusions precede a brief discussion of final conclusions. 
Comprising half the report are four appendixes comparing the two teacher 
evaluations of a student and the student self-evaluation with the aptitude profile and 
prediction. (AF) 
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A COfaPARATIVE STUDY OP EMLUATIONS 0? LANGUAGE LEARNING 
POTENTIAL BY APTITUDE BATTERY, Tv/0 TEACHER EVALUATIONS, 
AND STUDEp SSIP -EVALUATION 

John F* Bookman 



The Problem 

Carroll, Sapon, and Plinsleyr, among others, appear to 
have established the diagnostic and predictive pov/ers of 
language aptitude batteries such as the iCLAT and the Pirns leur 
Language Aptitude Bat teiy « Carroll maintains that ''fujcther 
research is needed to indicate what relationship- there may 
be between foreign language aptitude and the degree to which 
the individual is capable of coping with the pace of 
language instruction©” 

Pacing is more than careful timing© Assimilation of 
course content or development of skill must be effectively 
controlled by perception of instructional objectives in teimis 
of individual learning characteristics© Skill in identifying 
differentiated language learning characteristics would appear 
to be fujidamental to appropriate pacing practices. 

The purpose of this project, therefore, was to determine 
if possible, ho'w well both teacher and student recognize the 
latter *s language learning potential from progressive ex- 
perience, compared with his potential as revealed through 
language aptitude testing© Aptitude test results, of course. 



^ John B, Carroll, “Research in Teaching Foreign Languag 
Chapter 21 of Handbook of Research on Teaching , edited by N,L, 
Gage, p, 1069 



were not disclosed to either teacher or student during the 
experiment# , 

Some investigation of pacing practices was to be pro- 
posed depending on the outcome of this study.o 

The Pro.ject Desig n 

To discover something about the uniqueness of individual 
language learning characteristics, the Pirns leur Language 
Aptitude Battery v/as administered to 1,58? first-year foreign 
language students in five Tucson Public School high schools 
in September, 1967« This yielded objective data concerning 
the aptitude of each individual for learning language through 
word analysis, structural analysis, soiind discrimination, and 
sound-symbol association© Much useful supplementary data 
was also collected, e*g*, record of bilingualism in the 
student *s formative years, previous language study, and some- 
thing of the pattern of any previous foreign language study© 

The cards punched with these data v/ere sorted 

' 2 

from lowest to highest by sound^discrimination score# One 
hundred cards were selected for this project by pulling about 
twenty-five cards from the top of the deck, twenty-five from 
the bottom, and fifty from the middle©. A language aptitude 
profile was drawn for each individual from the four scores 

p 

‘’According to . . © investigation, there does exist 
a *ta3.ent* for learning foreign languages --that is, a special 
factor beyond 5,ntslligence and industriousness v/hich accounts 
for hov; v;ell an individual succeeds in a language courts e* 

« 0 © this special factor is auditory aptitude © © © •” • 

Paul Pimsleur, Underachievement in Foreign Language Learning- , 
p© 30. 
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of the battery: vocabulary, language analysis, sound discrimina 
tion, and soujid-symbol association, following a plan suggested 
by Pirasleuro Prom each prof 13 b a prediction was made concern- 
ing each student *s chance of success. 

To confirm prediction and to study hoy/ the teacher *s 
evaluation compared v/ith that of the battery, the teacher v/as 
asked in February, 1968 to rate the student as above-average, 
average, or below- average in four language areas roughly 
correlating with" the four parts of the aptitude battcryo 
For adjustment purposes, and to facilitate interpretation, 
the teacher was also asked to rate the student’s motivation 
and perseverance, as well as to specify the student’s style 
of learning as leaning toward analogy or analysis. 

Tine questionnaire used v/as similar in form to the personality 
appraisal forms that TPS teachers are familiar with, and 
which permit rating on a sliding scale© 

Bilingualism was soon recognized as a complication in 
the interpretation of teacher evaluations© Performance in 
the early stages may cloud the issue of aptitude in the 
study of the native language, which, in this case, v/as al- 
ways Spanish© Thus most bilingual students v/ere not carried 
in the study past the first teacher evaluation© Failure, 
withdrawal, or lack of teacher or student response reduced 
to 65 the number of students for v/hom complete data were 

3 

Albert Valdman, ed,. Trends in Language Learning , 
pp. 176-185. 
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collected throughout the study. Ty/enty teachers each submitted 
tv/o evaluations’ vhich v/ere used in the project© 

With the assistance of Ivirs. Phyllis Forbes, then 
research assistant in the Research Division of Tucson -Public 
Schools and nov/ teacher of German at Palo Verde High School, 
a more carefully designed instrument v/as developed for student 
self-evaluation in categories of language learning identical 
with those measured in teacher evaluation and correlated with 
the parts of the aptitude batterv". This instrument was sent 
to students in May, 1968, and 6$ v/ere returned© 

One week before the end of school, the teachers involved 
were asked to submit a second evaluation on a form similar to 
that used for the first evaluation© In addition, they were 
asked to verify the sti'"^ent*s mono- or bilingualism, and to 
specify the final grade© 

The data collected in the first and second teacher 
evaluation and in the student self-evaluation v/ere coded into 
IBM cards together w’.th aptitude test scores and subjected 
to a number of correlational studies© 

Appendix A shows the form for the teacher first ■ evaluation 
as it has been filled out by the teacher© 

Appendix B shows the same form with aptitude profile 
and prediction© An explanation of the graph is given on 
the following page. Notes to Appendix B. 

Append3.x C shows the form for the stu-dent self-evaluation 
as it has been filled out by the same student© 

Appendix D shows the form for the teacher second evaluation 
as it has been filled out by the teacher© All forms are for 
evaluations of the aptitude of the same student© 

ERIC : . — 
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Results of the Study 





TABLE I 


i'f ■ 


Corrclafiions b8tw66n TGacher First Evaluation and Stu** 


dent Self-Evaluation 


of Specific Skill 


Potentials 


(r) 


(P) 


Word Analysis 


.19 .... 




Structural Analysis.. 


.39 .... 


01 


Listening 


.38 .... 


05 


Speaking 


.51 .... 


01 



Tentative conclusion ; Table I may suggest that in the early stage of 
language learning, speaking potential is more unambiguously recognized by student 
and teacher than are other skill potentials. Teachers, or students, or perhaps 
both may experience difficulty correctly recognizing most kinds of skill potential 
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Tentative conclusions ; Table II may suggest that teacher and student 
evaluation of skill potentials approach one another with more experience, 
especially those skills measured in writing. Given adequate time, perhaps, 
teacher and student evaluation of these potentials might coincide. Question; 
Is this the result of teacher and student mutually discovering potential, or 
is the student’s estimate of himself shaped by the teacher? 



TABLE III 'JJ* 

Correlations between Teacher First Evaluation and 
Teacher Second Evaluation of^Sp^ecific Skill Potentials 

Word Analysis 

Structural Analysis 

Listening 

Speaking 

Tentative Conclusions ; Table III reveals a high degree of consistency 
between Teacher First and Teacher Second Evaluations. This may point to an 
early and unchangeably correct perception of the student’s potential, or to a 
freezing of a false estimate of the student’s potential, or to both in different 
teachers. Presumably the student’s recognition of his own potential undergoes 
the greater modification over time. 



( r ) 


^PJ 


.60 

% 


.. .01 


.76 ... 


.. .01 


.74 


.01 


.64 


.01 





TABLE IV 


-5C- 


Correlations between Aptitude Test 


Scores and Final 


Grades 


( r ) 


(p) 


Verbal Aptitude..... 


57 .... 


.01 


Auditory Aptitude.., 


37 .... 


... .05 


Total Aptitude 


.60 .... 


... .01 
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Tentative Conclusions ; From Table IV it may be concluded that the aptitude 
battery is a good predicter of academic success in foreign language study, with 
the verbal aptitude score being far better for this purpose than the auditory 
aptitude score. How intuition of this seems implicated in teacher evaluation 
of structural analysis potential may be noted in the following table. 





TABLE V 


N - 65 






Correlations between 


Total Aptitude Scores and Evaluations 


of Specific 


Skill Potentials in., 




(Evaluations) 








..Teacher 1st 


Teacher 2nd Student Self 




(r) (p) 


(r) ,(p). 




hi 


Word Analysis 


.28 (n.s.) 


.27 (n.s.) 


.32 


(.05) 


Structural Analysis 


.57 (.01) 


.54 (.01) 


.37 


(.05) 


Listening 


.33 (.05) 


.30 (.05) 


.20 


(n.s.) 


Speaking 


.41 (.01) 


.52 (.01) 


.43 


(.01) 



Tentative Conclusions ; Correlation between a specific aptitude as revealed 
by battery and as estimated by the teacher appears to be moderate, with the most 
significance revealed perhaps in the estimate of analytical potentxal. It is 
interesting to note how much less significant the student’s estimate would appear 
to be. 















Final Conclusions 

In' this study, twenty teachers, representing two-fifths 
of the foreign language teachers of Tucson Public Schools 
high schools, submitted their estimate of the potential of 
sixty-five beginning foreign language students for learning 
a language through assim.ilation of vocabulary, analysis of 
structure, listening comprehension, and speaking* They 
were given an opportunity to revise this e stimate at the 
end of the first year© . 

The students, for their part, contributed an evaluation 
of their ov/n potential for learning a language by the same 
categories © 

These three evaluations were measured against language 
aptitude test results to see hov/ well they correlate© 

We seem to have learned that students are not very able 
to judge their language-learning potential correctly, v/ith 
the possible exception of speaking© 

Teachers seem reasonably well able to gauge a student *s 
potential for analyzing language and for speaking, but may 
not adequately recognize a student*s potential for learning 
language through audition© 

The discrepancy between the high potential of TPS 
students for learning language through audition and the 
general condition that they must learn by analysis needs 
further exploration© 



January, 1969 
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appendix a 



Dear - s^i ^ : ' ' 









As you know, in September, 1967 the Pimslcur Language Aptitude 
Battery was administered to some of your first-year foreign language 
students. 



As a follow-up and check on the results of aptitude testing, vze have 
chosen a number of names by a type of random sampling. We hope to get 
additional information v/hich raay be useful in the interpretation of 
results. 



Comparing the above-named student vjith all other foreign- language 
students v;ith V7hom you have worked, V7ould you please check his rating 
in each of the follov/ing factors: ' ■ ' . 



1 . Knov/ledge of vocabulary 



2. Knowledge of gramrriatical 
functions and ability to 
use them 



3 . Skill in listening with 
comprehension 



4. Skill in control of the 
sound system, intonation, 
fluency of reading aloud.... 



5. Motiviition, 



Above- 

Average 


Average 


Below- 

Average 












/ 


# 


/ 1 








' 









6. Is the student better in oral '/or written 






v:ork? 



7 , Has the quality of his v;ork improved^ 
the beginning of this school year? 



or deteriorated i/ since 



Thank you very kindly. Please return this to me at your earliest op- 
portunity. 

Very truly yours. 



John F, Bocl'jnan 

Coordinator of Foreign Language Instruction 
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7. Has the quality of his- v/ork iinprovcd^ 
the beginning of this school year? 



or deteriorated si.nce 



Thank you very kindly. Please return this to me at your earliest op- 
portunity.' 



Ve ry t f u ly yours, 
John F. Boclcman 



Coordinator of Foreign Language Instruction 



I 









Notes to Appendix B 



The box in the upper left-hand corner represents the four parts of the 
language aptitude battery, from left to right: word analysis, structural analysis 
sound discrimination, and sound-S3mibol association. From top to bottom repre- 
sents placement of the score from two standard deviations above the (national) 
mean, through the mean, down to two standard deviations below the mean. The 
student whose language aptitude profile is graphed on the form, scored somewhat 
below the mean in word analysis, below the first standard deviation below the 
mean in structural analysis, at almost the third standard deviation above the 
mean in sound discrimination, and at almost the second standard deviation above 
the mean in sound-symbol association. The prognosis is that the student will be 
below average in reading and writing, but could be far above-average in speaking 
and listening. The solid black line represents the profile as determined by the 
aptitude battery. 

The teacher’s first evaluation is superimposed on this scale with the 
single dotted line. The three fields from top to bottom now indicate above- 
average, average, and be low- aver age. 

The double dotted line represents the student self-evaluation, and the 
double solid line, the teacher’s second evaluation. 






APPEI‘iDIX C 




Dear Scudent: 
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In September the Pimslcur Language Aptitude Battery was given to you and your 
classmates in your first-year foreign language class. Since then, information 
gained frotn the testing has been used to make a deeper study of language learning 
probleras than has ever before been made in Tucson Public Schools, 



It v/ill be of great help to us if you will now take the time, without consulting 
any other person, to read the statements below and nark one column "Yes,” "No,” 
or "Don’t Knov7." for each question. Please check each item. \ ■ 

Vhen you have done this, please seal the form in the envelope and return to your 
foreign language teacher to be forwarded to this office. > - 



Thank you very much for your cooperation. 



John F. Bockman 
Coordinator of Foreign 
Language Instruction 



^ ^ ^ ^ ^ ^ 4 V ^ ^ 



In comparison with other students in my first-year foreign language class, 



j 



vs 

I 



• ♦ 

1. ..learning and remembe?;ing vocabulary is 
very difficult for me. I can’t seem 
to remember V7ords very long. 


Yes 


X 


Don’t Know 


2. ..Grammar bores me, so I don’t bother 
vith it too much._ 




>< 

' *_ _• 1 




3. ■ ..I have little or no trouble understand- 
ing the spoken language.. 








4. . .my .pronunciation is pretty good. I 

feel I have mastered the sound system 
of the foreign language. 


- 


7 ^^ _ 

X 




5. ..my motivation for mastering this 
language is low. 








6. ..my written vrork seems to be bettet' 

than my oral v;ork (speaking and listen- 
ing.) 


■y. 






7. ..the quality., of my v'ork has improved 

since the b^giiming of the school year. 






• 
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*’ In comparison with other students in my first-year foreign language class,, , 



8, ..1 have a 'great deal of trouble under- 
standing wha.t the teacher is saying when 
he uses the foreign language 



9. ..there are a few rules of grammar that give 
me trouble, but I am generally able to 
use the language properly. 



10. ..I stumble over many words that I’ find hard 
. to pronounce t^hen I read the language out 
loud. 



11. ..my oral w’ork seems to be better than my 
-written w’ork._ ^ j 



12. ..I want very much to master this foreign 



language.^ 



13. ..I find that 1 seem to remember vocabulary 
quickly and easily 



14. ..the quality of my v:ork has stayed the sanu 
since the beginning of the year.^ 



15. have a great deal of trouble putting 

sentences together (either oral or v;rit- 
ten) so that they are grair-matically 
correct . ^ 



16. ..When I have had the opportunity to hear a 



native speaker speak the language I can 
generally understand it.^ 



17. 



.there are a few sounds which I have not 
yet mastered, but I don*t seem to have 
too. much trouble v;ith pronunciation.^ 



18. 



.there are alv;ays a few vocabulary vrords 
that 1 can never remember. 



19. 



.there is little or no difference in the 
quality of my written and oral work.^^ 



20 . 



.the quality of my work has deteriorated 
since the beginning of the school year.^ 



Yes 



/ 






X 



X 



X 



\y 

A 



X 



No 



V 






X 



X 



/ 






,_.X 



Don’t Know 






i 
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APPaSDIX D 



*■ / 

' 'is-:!. 

. "u 



Deal' 



As you knovr, in Septoinbor, 19'^7 the Pin-slcur Lari£;ua{ie Aptitude 
Battery v-as acrainl stored to 3.5)00 first-year foreign language 
students tliroughoiit the cist.r:*ct« • ' '*• 

As a follov:-up and check on the results of aptitude testing, \io ' 
selected about ten percent of the nariies by a type of randoin sampling 
for additional study. In February you v:cre asked to rate each 
student in the study in a nunbsr of factors that correlate with 
different kinds of language aptitude, ■ Later, the studs.nts were 
asked to rate themselves. 

Although this is the v:rcng time of the ycav to be putting extra 
burdens upon yoUj it wou3.d be extremely valuable to have an end*' 
of**year ra.ting from you to co:.:p3.eto this year-s study of the 
Individuals s.elspted for study. 

Comparing the a-bove^nained student with all other foreigri'*langu.age 
students vrith whcni you have v;orked, i.'ould you please check. his ratiur 
at year*s end in each of the following factors: 



lo Knovr3.edge of vocabulary, , o, , 

2c Knowledge of grarnmatical 
functions and abi3Aty to 
use tnon, c,,*oo«o,,coo,9,«co 

3* Skill in listening with 

coinpr ehensiLon o«,^«coo,*ooooo 

Ijo Skill in control, of the 
sound system, e.ntonation, 
fluency of reading aloud.,.© 

Mo oiLvate. on c*,..*.*<*c*o*occo 



Above- 

Average 


Average 


Below** 

Average 






/ ... 






/ 




■ / 




' 


1 

1 

» 













6, Is the studo.at better in oral y or v/ritten work? EquaUy 

good in both . 

7 , Has the quality of the vrork iriprovod_k_ or detcriorateci sanco 

the beginn3.ng of the year? 

• - 

8o Does the stuciont cone from a hone 5n whicli this language is used? 
Yes No 

9, Final gracir;; 3. 

Than]-: you very mu.ch . P.1 case I'ctarr. to: 

John F, iJocknian 
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